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Abstract 

This  paper  details  work  on  ordinary  differential  equations  that  continuously 
switch  among  regimes  of  operation.  In  the  first  part,  we  develop  some  tools  for 
analyzing  such  systems.  We  prove  an  extension  of  Bendixson’s  Theorem  to  the 
case  of  Lipschitz  continuous  vector  fields.  We  also  prove  a  lemma  dealing  with  the 
robustness  of  differential  equations  with  respect  to  perturbations  that  preserve  a 
linear  part,  which  we  call  the  Linear  Robustness  Lemma.  We  then  give  some 
simple  propositions  that  allow  us  to  use  this  lemma  in  studying  certain  singular 
perturbation  problems. 

In  the  second  part,  the  attention  focuses  on  example  systems  and  their  anal¬ 
ysis.  We  use  the  tools  from  the  first  part  and  develop  some  general  insights.  The 
example  systems  arise  from  a  realistic  aircraft  control  problem. 

The  extension  of  Bendixson’s  Theorem  and  the  Linear  Robustness  Lemma 
have  applicability  beyond  the  systems  discussed  in  this  paper. 


1  Introduction 

1.1  Background  and  Motivation 

This  paper  details  work  on  ordinary  differential  equations  (ODEs)  that  continuously 
switch  among  regimes  of  operation.  We  have  in  mind  the  following  model  as  a  proto¬ 
typical  example  of  a  switching  system: 

x(t)  =  Fi(x(t),t),  x(0)=x0  (1) 
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where  x(-)  €  Rn  and  i  =  1, . . . ,  N.  Such  systems  are  of  “variable  structure”  or  “multi¬ 
modal”;  they  are  a  special  case  of  hybrid  systems.1  For  instance,  the  particular  i  at  any 
given  time  may  be  chosen  by  some  “higher  process,”  such  as  a  controller,  computer, 
or  human  operator.  It  may  also  be  a  function  of  time  or  state  or  both.  In  the  latter 
case,  we  may  really  just  arrive  at  a  single  (albeit  complicated)  nonlinear  time-varying 
equation.  However,  one  might  gain  some  leverage  in  the  analysis  of  such  systems  by 
considering  them  to  be  amalgams  of  simpler  systems.  We  add  the  assumptions  that 
(1)  each  F{  is  globally  Lipschitz  continuous  and  (2)  the  i’s  are  picked  in  such  a  way 
that  we  have  finite  switches  in  finite  time. 

In  this  paper  we  study  continuous  switching  systems.  A  continuous  switching  sys¬ 
tem  is  a  switching  system  with  the  additional  constraint  that  the  switched  subsystems 
agree  at  the  switching  time.  More  specifically,  consider  Equation  (1)  and  suppose 
that  at  times  tj,  j  =  1, 2, 3, . . .  ,  there  is  a  switch  from  F]Cj_1  to  F^  .  Then  we  require 
Fk^i{x{tj),tj)  =  Fk.{x(tj),tj).  That  is,  we  require  that  the  vector  field  is  continuous 
over  time. 

This  constraint  leads  to  a  simpler  class  of  systems  to  consider.  At  the  same  time, 
it  is  not  overly  restrictive  since  many  switching  systems  naturally  satisfy  this  con¬ 
straint.  Indeed  they  may  even  arise  from  the  discontinuous  logic  present  in  hybrid 
systems.  For  example,  we  might  have  an  aircraft  where  some  surface,  say  the  elevator, 
controls  the  motion.  But  this  elevator  is  in  turn  a  controlled  surface,  whose  desired 
action  is  chosen  by  a  digital  computer  that  makes  some  logical  decisions.  Based  on 
these  decisions,  the  computer  changes  elevator  inputs  (say  current  to  its  motor)  in  an 
effectively  discontinuous  manner.  However,  the  elevator  angle  and  angular  velocity 
do  not  change  discontinuously.  Thus,  from  the  aircraft’s  point  of  view  (namely,  at 
the  level  of  dynamics  relevant  to  it),  there  are  continuous  switchings  among  regimes 
of  elevator  behavior.  Therefore,  continuous  switching  systems  arise  naturally  from 
abstract  hybrid  systems  acting  on  real  objects.  In  this  paper  we  develop  tools  that 
are  useful  in  analyzing  these  situations. 

Another  problem  arises  in  examples  like  the  one  we  just  introduced:  the  problem  of 
unmodeled  dynamics.  Suppose  the  pilot,  from  some  quiescent  operating  point,  decides 
to  invoke  hard  upward  normal  acceleration.  The  elevator  starts  swinging  upward  until 
it  is  swinging  upward  at  maximum  angular  velocity  (in  an  effort  track  the  violent 
maneuver  requested  by  the  pilot).  Then,  some  higher  process  makes  a  calculation 
and  decides  that  continuing  this  command  would  result  in  an  unsafe  configuration 
(say  attack  angle  beyond  critical).  It  decides  to  begin  braking  the  elevator  motor 
immediately  to  avoid  this  situation.  In  this  case,  the  desired  angular  velocity  profile 
of  the  elevator  (over  the  whole  move)  is  most  probably  trapezoidal.  However,  the 
elevator  is  a  dynamic  element  that  can’t  track  that  desired  profile  exactly.  We  may 
want  to  know  how  taking  these  unmodeled  dynamics  into  account  affects  our  already 
modeled  dynamics.  We  may  also  want  to  know  how  high  our  control  gains  should  be 
to  track  within  a  certain  error.  We  develop  some  tools  that  allow  us  to  answer  both 
these  questions. 

'Hybrid  systems  are  those  that  inherently  combine  logical  and  continuous  processes,  e.g.,  coupled 
finite  automata  and  ODEs. 
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1.2  Overview 


In  the  first  part  of  the  paper  (Section  2),  we  develop  general  tools  for  analyzing  contin¬ 
uous  switching  systems.  For  instance,  we  prove  an  extension  of  Bendixson’s  Theorem 
to  the  case  of  Lipschitz  continuous  vector  fields.  This  gives  us  a  tool  for  analyzing 
the  existence  of  limit  cycles  of  continuous  switching  systems.  We  also  prove  a  lemma 
dealing  with  the  continuity  of  differential  equations  with  respect  to  perturbations  that 
preserve  a  linear  part.  Colloquially,  this  lemma  demonstrates  the  robustness  of  ODEs 
with  a  linear  part.  For  purpose  of  discussion,  we  call  it  the  Linear  Robustness  Lemma. 
This  lemma  is  useful  in  easily  deriving  some  of  the  common  robustness  results  of  non¬ 
linear  ODE  theory  (as  given  in,  for  instance,  [2]).  This  lemma  also  becomes  useful  in 
studying  singular  perturbations  if  the  fast  dynamics  are  such  that  they  maintain  the 
corresponding  algebraic  equation  to  within  a  small  deviation.  We  give  some  simple 
propositions  that  allow  us  to  do  this  type  of  analysis. 

The  extension  of  Bendixson’s  Theorem  and  the  Linear  Robustness  Lemma  have 
uses  beyond  those  explicitly  espoused  here  and  should  be  of  general  interest  to  systems 
theorists. 

In  the  second  part  (Sections  3  and  4),  we  use  the  above  tools  to  analyze  some 
example  continuous  switching  systems  motivated  by  a  realistic  aircraft  control  prob¬ 
lem.  In  Section  3,  we  present  an  example  continuous  switching  control  problem.  This 
system  is  inspired  from  one  used  in  the  longitudinal  control  of  modern  aircraft  such  as 
the  F-8  [15].  The  control  law  uses  a  “logical”  function  (max)  to  pick  between  one  of 
two  stable  controllers:  the  first  a  servo  that  tracks  pilot  inputs,  the  second  a  regulator 
about  a  fixed  angle  of  attack.  The  desired  effect  of  the  total  controller  is  to  “track 
pilot  inputs  except  when  those  inputs  would  cause  the  aircraft  to  exceed  a  maximum 
angle  of  attack.”  We  analyze  the  stability  of  this  hybrid  system  in  the  case  where  the 
pilot  input  is  zero  and  the  controllers  are  linear  full-state  feedback.  We  call  this  the 
max  system.  While  the  restriction  to  this  case  seems  strong,  one  should  note  that 
the  stability  of  such  systems  is  typically  verified  only  by  extensive  simulation  [15].  In 
this  paper,  we  use  the  tools  discussed  above  to  prove  nontrivial  statements  about  the 
controller’s  behavior.  For  example,  we  show  that  no  limit  cycles  exist  by  applying  our 
extension  of  Bendixson’s  Theorem.  We  also  show  that  the  family  of  linear  full-state 
feedback  max  systems  can  be  reduced  to  a  simpler  family  via  a  change  of  basis  and 
analysis  of  equilibria.  Finally,  we  give  a  Lyapunov  function  that  proves  that  all  sys¬ 
tems  of  this  canonical  form  are  globally  asymptotically  stable.  The  Lyapunov  function 
itself  has  a  logical  component,  and  the  proof  that  it  diminishes  along  trajectories  is 
split  into  logical  cases. 

In  Section  4,  we  analyze  a  “simulation”  of  the  max  system.  Specifically,  we  use 
a  dynamic  variable  (output  of  a  differential  equation)  instead  of  the  output  given  by 
the  max  function  directly.  This  corresponds  to  a  dynamical  smoothing  or  switching 
hysteresis,  as  we  motivated  above.  By  using  our  lemma  on  the  robustness  of  linear 
ODEs,  we  conclude  stability  properties  of  this  (singular  perturbation)  simulation  from 
those  of  the  original  max  system. 

Finally,  Section  5  presents  a  summary  and  conclusions.  Appendix  A  collects  the 
more  tedious  proofs.  Appendix  B  treats  the  background,  statement,  and  proof  of  our 
extension  of  Bendixson’s  Theorem. 
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1.3  Notation 


Throughout  this  paper  we  use  the  notation  of  modern  control  theory  [9,  14,  6,  3], 
ODEs  [1,  5],  and  nonlinear  systems  analysis  [17,  13]. 

2  Theory 

In  this  section  we  summarize  some  general  tools  for  the  analysis  of  continuous  switching 
systems.  The  first  new  tool  we  introduce  is  an  extension  of  Bendixson’s  Theorem  on 
the  existence  of  limit  cycles  to  the  case  of  Lipschitz  continuous  vector  fields.  The 
second  is  a  lemma  we  recently  proved  dealing  with  the  robustness  of  ODE’s  with 
respect  to  perturbations  that  preserve  a  linear  part.  Finally,  we  prove  some  simple 
propositions  that  allow  us  to  use  the  robustness  lemma  to  analyze  certain  singular 
perturbation  problems.  Later,  we  apply  each  of  these  results  to  analyze  our  example 
problems. 

2.1  Limit  Cycles 

Suppose  we  are  interested  in  the  existence  of  limit  cycles  of  continuous  switching 
systems  in  the  plane.  The  traditional  tool  for  such  analysis  is  Bendixson’s  Theorem. 
But  under  our  model,  systems  typically  admit  vector  fields  that  are  Lipschitz,  with 
no  other  smoothness  assumptions.  Bendixson’s  Theorem,  as  it  is  traditionally  stated 
(e.g.,  [4,  17]),  requires  continuously  differentiable  vector  fields  and  is  thus  not  of  use  in 
general.  Therefore,  we  offer  an  extension  of  Bendixson’s  Theorem  to  the  more  general 
case  of  Lipschitz  continuous  vector  fields.  Its  proof  is  based  on  results  in  geometric 
measure  theory  (which  are  discussed  in  Appendix  B). 

Theorem  1  (Extension  of  Bendixson’s  Theorem)  Suppose  D  is  a  simply  con¬ 
nected  domain  in  R 2  and  f(x)  is  a  Lipschitz  continuous  vector  field  on  D  such  that 
the  quantity  V/(ar)  (the  divergence  of  f,  which  exists  almost  everywhere)  defined  by 

v/w  =  i)(xi’I2)+^(li’I2) 

is  not  zero  almost  everywhere  over  any  subregion  of  D  and  is  of  the  same  sign  almost 
everywhere  in  D.  Then  D  contains  no  closed  trajectories  of 

Xl  (t)  -  fi[xi(t),x2(t)] 

X2  (t)  =  h[x\{t),x2{t)] 

Proof  Similar  to  that  of  Bendixson’s  Theorem  [17,  pp.  31-32]  after  using  an  exten¬ 
sion  of  the  divergence  theorem  known  as  the  Gauss-Green-Federer  Theorem  [10,  pp. 
114-115].  (See  Appendix  B.)  □ 

2.2  Robustness  of  ODEs 

In  this  subsection,  we  summarize  some  results  that  show  the  robustness  of  solutions  of 
ordinary  differential  equations  with  respect  to  perturbations  of  the  vector  field.  First, 
we  give  and  prove  a  basic  lemma  in  ODE  theory  that  demonstrates  robustness  of 
solutions  to  arbitrary  perturbations.  Then,  we  consider  perturbations  that  preserve 
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a  linear  part.  This  allows  us  to  obtain  more  useful  bounds.  We  call  the  result  the 
Linear  Robustness  Lemma. 

The  proofs  of  both  lemmas  depend  critically  on  the  well-known  Bellman-Gronwall 
inequality  [3,  p.  252],  which  is  reprinted  in  Appendix  A  for  convenience.  The  first  is 
a  basic  lemma  in  ODE  theory  that  was  given  without  proof  in  [18].  It  is  useful  as  a 
comparison  with  our  new  result,  Lemma  3.  For  completeness,  we  furnish  a  proof  in 
Appendix  A.2 

Lemma  2  Given 


x  =  F(x,t ),  :r(0)  =  xq 
y  =  G(y,t),  y(0)=x0 

Suppose  that  F  is  globally  Lipschitz  continuous  and  “close  to  G,”  i.e., 

II F(x,t)  -  F{y,t) ||  <  L\\x-y\\,  for  all  x,y,t 

\\F(x,t)  —  G(x,t)\\  <  e,  for  all  x,t 


Then  if  L  ^  0 

||x(f)  -  y(f)||  <  j-  (eLt  -  l)  ,  for  all  t  >  0 
If  L  =  0,  then  ||rc(i)  —  y(t)||  <  et. 


Proof  (See  Appendix  A.)  □ 

The  problem  with  this  result  is  that  (except  in  the  trivial  case)  L  >  0,  so  the  bound 
diverges  exponentially.  Thus  it  is  not  useful  in  deducing  stability  of  a  nearby  system, 
nor  in  examining  robustness  of  a  well-behaved  model  to  perturbations  in  the  vector 
field.  There  are  some  tools  for  this  in  the  literature,  under  the  heading  “stability  under 
persistent  disturbances.”  For  example,  [11,  p.  72]  gives  a  local  result.  We  are  more 
interested  in  what  one  can  say  globally.  Along  these  lines  we  consider  perturbations 
that  preserve  a  well-defined  portion  of  the  dynamics,  a  linear  part.  Here  is  our  main 
result: 

Lemma  3  (Linear  Robustness  Lemma)  Given 

x  =  Ax  +  F(x,t),  x(0)  =  xo 
y  =  Ay  +  G{y,t),  y(  0)  =  x0 

Suppose  that  F  is  globally  Lipschitz  continuous  and  “close  to  G,”  i.e., 

\\F(x,t)  -F(y,t) ||  <L\\x-y\\,  for  all  x,y,t 
\\F(x,t)  —  G(x,t)  ||  <  e,  for  all  x,t 


Then 

IkOO  -  y(*)||  <  +cL  (e{ri+cL)t  -  l)  ,  for  all  t  >  0 

when 

I \eAt\\i<ce^  (2) 

where  ||  ■  ||j  is  the  induced  norm  associated  with  the  norm  ||  •  ||  and  c  >  1,  y  +  cL  7^  0, 
y  ^  0,  and  L  >  0. 

2  Proofs  that  interrupt  the  flow  of  discussion  or  do  not  use  novel  techniques  are  relegated  to  Ap¬ 
pendix  A. 
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Proof  (See  Appendix  A.) 

Corollary  4  In  some  special  cases  not  covered  above  we  have: 


□ 


1.  If  L  =  0  but  i)  7^  0,  then 

Mt)-y(t)\\<j(e*-l) 


2.  If  rj  =  0  and  L  —  0,  then 


3.  If  rj  =  0  but  L  >  0,  then 

\\<t)-y(t)\\<{{ecL,-i) 


4 .  If  rj  7^  0  and  L  >  0  but  r]  +  cL  =  0  ( this  means  r)  <  0),  then 

ll*(<)  -  vtf)  II  <  [cLt  +  e~cLT  ~ e7,t] 


Proof  (See  Appendix  A.)  □ 

The  similarity  of  Lemmas  2  and  3  is  easy  to  see.  Their  proofs  are  also  similar. 
The  most  important  distinction  arises  when  A  is  stable  and  p  can  be  chosen  negative. 
Indeed,  if  77  +  cL  <  0,  then  we  can  guarantee  nondivergence  of  the  solutions. 

The  proof  can  easily  be  extended  to  the  case  where  A  is  time-varying: 

Corollary  5  Lemma  3  and  Corollary  4  hold  when  A  is  time  varying,  with  Equation 

(2)  replaced  by 

Mt,s)\\i<ce^ 

where  $(£,  s)  is  the  transition  matrix  of  the  time-varying  linear  matrix  A{t). 

Proof  Proof  is  the  same  as  that  for  Lemma  3,  replacing  by  $(£,  s).  □ 

Then,  the  case  L  =  0  subsumes  some  of  the  global  results  of  stability  under  per¬ 
sistent  disturbances,  e.g.,  [2,  p.  167]. 

2.3  Singular  Perturbations 

The  standard  singular  perturbation  model  is  [7] 

x  =  f(x,z,e,t),  x(to)=x 0,  x  e  Rn  (3) 

ez  =  g(x,  z,  e,  t),  z(t0)  =  zQ,  z  €  Rm  (4) 

in  which  the  derivatives  of  some  of  the  states  are  multiplied  by  a  small  positive  scalar 
e.  When  we  set  e  =  0,  the  state-space  dimension  reduces  from  n  +  m  to  n  and  the 
second  differential  equation  degenerates  into  an  algebraic  equation.  Thus,  Equation 

(3)  represents  a  reduced-order  model,  with  the  resulting  parameter  perturbation  being 
“singular.”  The  reason  for  this  terminology  is  seen  when  we  divide  both  sides  of 
Equation  (4)  by  e  and  let  it  approach  zero. 
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We  make  use  of  the  simpler  model 

x  =  f(x,z,t),  x(to)  =  xo,  x  €  Rn 

z  =  a2[g(x,  t)  —  z],  z(to)  =  zq,  z  €  Rm 

where  we  have  e  =  1/a2 ,  a  a  nonzero  real  number.  With  this  rewriting,  one  sees  why 
Equation  (4)  is  said  to  represent  the  “fast  transients,”  or  fast  dynamics.  The  following 
lemma  shows  explicitly  a  certain  case  where  the  dynamics  can  be  made  so  fast  that 
the  resulting  “tracking  error”  between  u(t)  =  g(x(t),  t)  and  z(t)  is  kept  small. 

Lemma  6  Let 

z(t )  =  a2(u(t)  —  z(t)) 

where  u  is  a  Lipschitz  continuous  (with  constant  L)  function  of  time.  Given  any  e  >  0, 

if 

|z(0)  -  u(0)|  =  e0  <  e 
we  can  choose  a  large  enough  so  that 

| z{t)  —  u(t)  |  <  e,  t  >  0 

Proof  (See  Appendix  A.)  □ 

The  result  can  be  extended  to  higher  dimensions  as  follows: 

Lemma  7  Let 

z(t )  =  a2A(u(t)  —  z(t)) 

where  u  and  z  are  elements  of  Rn  and  A  €  RnXn.  Further,  assume  that  A  is  positive 
definite  and  that  each  coordinate  of  u  is  a  Lipschitz  continuous  (with  constant  L) 
function  of  time.  Given  any  e  >  0,  if 

H-z(O)  -  u(0)||  =  e0  <  e 

we  can  choose  a  large  enough  so  that 

|| z(t)  —  u(t)||  <  e,  t  >  0 

Proof  Similar  to  the  proof  of  Lemma  6.  [Hint:  consider  the  time  derivative  of  eTe , 
e  ==  (z  —  «),  and  use  equivalence  of  norms  on  Rn.}  □ 

These  lemmas  allow  us  to  use  the  robustness  lemmas  of  the  previous  section  to 
analyze  certain  singular  perturbation  problems.  The  idea  of  the  preceding  lemmas 
is  that  the  fast  dynamics  are  such  that  they  maintain  the  corresponding  algebraic 
equation,  z(t )  =  u(t),  to  within  a  small  deviation  (cf.  invariant  manifolds  [7,  p.  18]). 

3  Example  1:  Max  System 

As  an  example  of  a  switched  system,  we  consider  a  problem  combining  logic  in  a 
continuous  control  system.  Specifically,  we  start  with  the  system 
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or,  symbolically, 


x  =  Ax  +  B8 
a  =  C\x  +  D\5  —  C\x 
nz  =  C2x  +  D28 

These  equations  arise  from  the  longitudinal  dynamics  of  an  aircraft  (see  Figure  1) 
with  reasonable  values  chosen  for  the  physical  parameters.  The  variable  6  is  the  pitch 
angle  and  a  is  the  angle  of  attack.  The  input  command  <5  is  the  angle  of  the  elevator. 
The  normal  acceleration,  nz,  is  the  output  variable  which  we  would  like  to  track, 
i.e.,  we  assume  that  the  pilot  requests  desired  values  of  nz  with  his  control  stick. 
As  a  constraint,  the  output  variable  a  must  have  a  value  not  much  larger  than  ai;m 
(for  the  model  to  be  valid  and  the  plane  to  be  controlled  adequately).  A  successful 
controller  would  satisfy  both  of  these  objectives  simultaneously  to  the  extent  that  this 
is  possible:  we  desire  good  tracking  of  the  pilot’s  input  without  violating  the  constraint 
a  <  aqim  -f  e,  for  e  >  0  some  safety  margin. 

Now,  suppose  that  two  controllers,  K\  and  K2,  have  been  designed  to  output  <Si 
and  82  such  that  (1)  S  is  regulated  about  a  =  anm  when  S  =  <h;  and  (2)  S  tracks 
command  r — the  pilot’s  desired  nz — when  0  =  S2,  respectively.  Finally,  suppose  that 
we  add  the  following  logical  block:  8  =  max(<5i,  82).  Control  configurations  much 
like  this  (see  Figure  2)  have  been  used  to  satisfy  the  objectives  of  our  aircraft  control 
problem  [15]. 

To  our  knowledge,  the  stability  of  such  systems  has  only  been  probed  via  extensive 
simulation  [15].  In  the  remainder  of  this  section,  we  examine  the  stability  of  certain 
cases  of  this  control  system.  First,  we  limit  ourselves  to  the  case  where  both  controllers 
are  implemented  with  full-state  feedback.  We  discuss  the  well-posedness  of  the  system 
and  show  an  example  output  run.  Next,  we  consider  the  equilibrium  points  of  the 
system  and  their  stability  in  the  case  where  the  pilot’s  reference  input  (desired  normal 
acceleration)  is  clamped  to  zero.  More  practically,  we  answer  the  question,  What  is 
the  behavior  of  this  control  system  if  the  pilot  lets  go  of  the  control  stick? 

3.1  Preliminary  Analysis  of  the  Example  System 

First  note  that  in  our  example  system,  the  pair  (A,  B)  is  controllable.  To  make  some 
headway,  we  restrict  ourselves  to  the  special  case  where  the  controllers  K\  and  K2 
take  the  form  of  full-state  feedback  plus  an  offset  term  (for  nonzero  outputs): 

51  =  -Fx  +  iCii-A  +  BF^B]-1^ 

52  =  -Gx  +  {{C2-D2G){-A  +  BG)-lB  +  D2}~lr 

For  convenience,  we  let 

ki  =  [Cxi-A  +  BFy'B]-1 

k2  =  {{C2-D2G){-A  +  BG)-lB  +  D2]~l 

Such  constants  generally  need  not  exist.  However,  for  our  system  we  are  keenly  inter¬ 
ested  in  the  existence  of  k\  ,3  We  have  the  following 

3We  assume  k?  exists  since  it  does  not  affect  our  later  analysis,  which  is  in  the  case  r  =  0. 
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Fact  8  The  constant  k\  is  guaranteed  to  exist  for  our  system  whenever  F  is  chosen 
such  that  ( A  —  BF)  is  stable.4 

Proof  (See  Appendix  A.)  □ 

Thus,  the  resulting  max  control  law  exists.  It  is  simply 

S  =  max.(—Fx  +  kianm, —Gx  +  k2r)  (5) 

To  get  a  feel  for  how  the  example  system  behaves,  we  have  included  some  simulations. 
Figure  3  shows  an  example  run  of  the  just  the  tracking  portion  of  the  control  system 
(“lim  —  0.6,  F  chosen  to  place  the  closed-loop  poles  at  —6  and  —7).  Part  (a)  shows 
normal  acceleration  tracks  the  desired  trajectory  well;  (b)  shows  the  aiim  constraint 
is  violated  to  achieve  this  tracking. 

Figure  4  shows  the  outputs  when  the  full  max  control  system  is  activated  (with 
both  F  =  G  chosen  as  F  above).  One  easily  sees  that  the  controller  acts  as  expected:  it 
tracks  the  desired  command  well,  except  in  that  portion  where  tracking  the  command 
requires  that  the  ayim  constraint  be  violated.  In  this  portion,  a  is  kept  close  to  its 
constraint  value  (the  maximum  value  of  a  in  this  simulation  run  was  0.6092). 


3.2  Analysis  for  the  Case  r  =  0 

The  first  thing  we  do  is  examine  stability  of  E  using  the  max  control  law  in  the  case 
where  r  =  0.  The  closed-loop  system  equations  are  then 

x  =  Ax  +  B  max(— Fx  +  —  Gx) 

=  (A  —  BG)x  -I-  B  max((G  —  F)  +  Aqaijm,  0) 

In  our  analysis  below,  we  suppose  that  we  have  done  a  reasonable  job  in  designing  the 
feedback  controls  F  and  G.  That  is,  we  assume  (A  —  BF)  and  (A  —  BG)  are  stable. 
This  is  possible  because  (A,  B)  controllable. 

Now,  recall  that  (A,  B )  controllable  implies  that  ( A  —  BG ,  B)  is  controllable.  Thus, 
it  suffices  to  analyze  the  following  equation,  which  we  call  the  max  system: 

Definition  9  (Max  System) 

2max  •  i  =  Az  +  B  max(Fz  4-  7, 0) 

where  A  and  A  +  BF  are  stable  and  ( A,B )  is  controllable  and  7  =  kya\\m. 

To  fix  ideas,  let’s  look  at  simulation  results.  Figure  5  shows  a  max  system  trajectory 
with 


0.1 

-1  -0.1  I  ’ 


F=  [  -9  0  ]  ,  7  =  -1 


Figure  75  shows  the  trajectory  resulting  from  the  same  initial  condition  for  the  system 
x  =  Ax ;  Figure  8  for  the  system  x  =  (A  +  BF)x.  Both  component  systems  are  stable. 

4We  say  a  matrix  is  stable  when  all  its  eigenvalues  are  strictly  in  the  left-half  plane. 

5We  intentionally  skipped  a  figure  to  allow  better  figure  placement  for  comparison. 
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To  simplify  analysis  of  the  max  system,  we  can  make  a  change  of  basis  (x  —  Pz), 
yielding 


x  =  Pz 

=  PAz  A  PB  max(.F,2:  +  7, 0) 

=  PAP~ 1  x  +  PB  ma x(FP~ 1  x  +  7, 0) 


where  P  is  any  nonsingular  matrix.  In  particular,  P  can  be  chosen  so  that  the  matrices 
PAP~l  and  PB  are  in  the  so-called  controller  canonical  form: 


PAP~l  = 


PB 


0 

— 00 

0 
1 


-ai 


(6) 


(7) 


Note  that  a*  >  0  since  PAP  1  is  a  stable  matrix.  Renaming  matrices  again,  we  have 
Fact  10  The  max  system  Emax  can  be  reduced  to  the  system: 


x  =  Ax  A  B  ma x(Fx  +  7, 0) 

where  A  and  A  +  BF  are  stable,  ( A,B )  is  controllable,  and  the  matrices  A  and  B  are 
in  controller  canonical  form. 

We  can  do  one  more  thing  to  simplify  the  max  system  just  derived:  expand  the 
equations  using  the  fact  that  A  and  B  have  controller  canonical  form.  Doing  this — and 
some  equilibrium  point  analysis — we  obtain 

Remark  11  (Canonical  Max  System)  1.  The  max  system  can  be  reduced  to 
the  following  canonical  form: 


x  =  y 

y  =  —ax  —  by  A  ma x(/x  A  gy  A  7, 0) 

where  a,  b,  a  —  f ,  and  b  —  g  are  greater  than  zero. 

2.  Further,  without  loss  of  generality,  we  may  assume  that  7  <  0 ,  in  which  case  the 
only  equilibrium  point  of  this  system  is  the  origin. 

Proof  The  first  part  is  a  straightforward  calculation,  with  the  inequalities  on  the 
constants  arising  from  the  assumed  stability  of  A  and  A  +  BF. 

Now,  let’s  analyze  the  equilibrium  points  of  the  canonical  max  system.  The  rele¬ 
vant  equations  are  y  =  0  and  ax  =  max(/x  +  7, 0).  This  second  one  must  be  analyzed 
in  two  cases: 


ax  =  0,  fx  +  7  <  0 
ax  =  fx  Ay,  fx  A  7  >  0 

Thus,  (0, 0)  is  an  equilibrium  point  if  and  only  if  7  <  0;  (7 /(a  —  /) ,  0)  is  an  equilibrium 
point  if  and  only  if 

/ 

- 7  7  +  7  >  0 

a~  f 


7  >  0 
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where  the  last  line  follows  from  a  and  a  —  f  greater  than  zero.  Therefore,  the  canonical 
max  system  has  exactly  one  equilibrium  point. 

Finally,  if  7  >  0,  changing  coordinates  to  z  =  x  —  j/(a  —  f )  yields  z  =  y  and 

y  =  -a(^z  +  ~jj  ~by  +  max  (j  (z  4-  +  9V  +  7, 0 

<27  (  <27 

=  -az-by - -  +  max  [fz  +  gy-i - j,0 

a~  I  \  a~ f 

=  -az  -  by  +  fz  +  gy  +  max  (  0,  -fz  -  gy - - 

V  a 

=  -(a-f)z-  (b-g)y  +  max  ({-f)z  +  {-g)y+  ,0^) 

Now  introducing  new  variables  for  the  constants  in  parentheses,  we  obtain 

z  =  y 

y  =  -az  -by  +  ma x(fz  +  gy  +  7, 0) 

It  is  easy  to  check  that  the  new  variables  satisfy  the  inequalities  of  the  canonical  form. 
Further,  we  have  7  <  0,  and  thus  (0, 0)  the  only  equilibrium.  □ 

Next,  note  that  this  is  equivalent  to  the  second-order  system: 

x  =  —ax  —  bx  +  ma x(/x  +  gx  +  7, 0) 

which  we  use  below. 

We  have  the  following  global  results  for  the  max  system  in  the  case  where  the 
reference  input,  r ,  is  zero: 

1.  Limit  cycles  don’t  exist.  Our  max  system  consists  of  a  logical  (though  Lipschitz 
continuous)  switching  between  two  stable  linear  systems,  both  of  which  admit 
negative  divergence  in  their  respective  regions.  Therefore,  by  Theorem  1,  no 
limit  cycles  can  exist. 

2.  The  system  is  globally  asymptotically  stable.  The  proof  is  detailed  below. 

To  prove  global  asymptotic  stability,  we  first  show 

Remark  12  The  following  is  a  Lyapunov  function  for  the  canonical  max  system: 

V  =  t;&2  +  Jq  [a£  -  max(/£  +  7, 0)]d£ 

=  \±2  +  J0 

Proof  The  proof  has  two  major  parts:  (i)  V  is  a  positive  definite  (p.d.)  function, 
and  (ii)  V  <  0. 

(i)  To  show  that  V  is  a  p.d.  function,  it  is  enough  to  show  that  xc(x )  >  0  when 
x  7^  0  and  c(0)  =  0.  The  second  fact  follows  from  7  <  0.  Computing 

xc(x)  =  ax2  —  x  ma x(/x  +  7, 0) 

ax2,  fx  +  7  <  0 

ax2  —  fx 2  —  7X,  fx  +  7  >  0 

That  the  desired  condition  holds  in  the  first  case  follows  immediately  from  a  >  0. 
For  the  second  case,  we  consider 
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1.  x  >  0: 

ax 2  —  fx2  —  7 x  =  (a  —  f)x2  +  (—7)2;  >0  +  0  =  0 

2.  x  <  0: 

ax2  —  fx2  —  -yx  =  ax2  +  {—x){fx  +  7)  >0  +  0  =  0 
Thus  F  is  a  p.d.  function. 

(ii)  Next,  we  wish  to  show  that  V  <  0.  To  that  end,  we  compute 
V  =  xx  +  c(x)x 

=  x[—ax  —  bx  +  ma x(/x  +  gx  +  7, 0)]  +  axx  —  max(/x  +  7, 0)x 
=  —bx2  +  i  max(/x  +  gx  +  7, 0)  —  x  max(/i  +  7, 0) 

Now,  there  are  four  cases  to  be  dealt  with: 

1.  If  fx  +  gx  +  7  <  0  and  fx  +  7  <  0,  then  V  =  —bx2  <  0. 

2.  If  fx  +  gx  +  7  >  0  and  /x  +  7  >  0,  then  F  =  —  (b  —  g)x2  <  0. 

3.  If  fx  +  gx  +  7  <  0  and  fx  +  7  >  0,  then 

F  =  — 6x2  —  x(/x  +  7) 

If  x  >  0,  then  V  <0.  If  x  <  0,  then,  using  (b  —  g)  >  0,  we  obtain 


6 

> 

9 

bx 

< 

gx 

fx  +  'y  +  bx 

< 

fx  +  'y  +  gx 

fx  +  7  +  bx 

< 

0 

x[fx  +  7  +  bx] 

< 

0 

V 

< 

0 

4.  If  fx  +  gx  +  7  >  0  and  fx  +  7  <  0,  then 

V  =  — bx 2  +  x(/x  +  xg  +  7) 

If  x  <  0,  then  V  <  0.  If  x  >  0, 

V  =  — ( b  —  g)x2  +  x(fx  +  7)  <  0 


□ 

Global  asymptotic  stability  results  from  the  facts  that  (1)  the  origin  is  the  only 
invariant  set  for  which  V  =  0  and  (2)  F(x)  -+  00  as  |[x||  -7  00  [13]. 


4  Example  2:  The  Simulated  Max  System 

In  this  section  we  analyze  a  variant  of  the  max  system  introduced  in  Section  3.  Specif¬ 
ically,  recall  that  the  max  system  can  be  reduced  to  the  canonical  form  of  Remark 
11: 

x  =  y 

y  =  —  ax  —  by  +  max(/x  +  gy  +  7, 0) 
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where  a,  b,  a  —  /,  and  b  —  g  are  greater  than  zero  and  7  <  0.  It  was  shown  in 
Section  3  that  the  only  equilibrium  point  of  this  system  is  the  origin,  which  is  globally 
asymptotically  stable. 

In  the  simulated  max  system  (i.e.,  using  a  differential  equation  for  the  max  func¬ 
tion)  we  have  the  following  system  of  equations  (cf.  Definition  9): 

Definition  13  (Simulated  Max  System) 

x  =  Ax  4-  BS 
5  =  a2[max(F2:  +  7,0)  —  5] 

where  A  and  A  +  BF  are  stable  and  ( A,B )  is  controllable.  Also,  7  =  Aqaijm  and 
a^O. 

This  equation  represents  a  smoothing  of  the  max  function’s  output;  it  provides  a  type 
of  hysteresis  that  smooths  transitions.  Note  that  this  equation  represents  a  singular 
perturbation  of  the  original  max  system.  It  can  be  used  to  model  the  fact  that  the 
elevator  angle  does  not  exactly  track  the  desired  control  trajectory  specified  by  the 
max  function.  To  compare  the  max  and  simulated  systems,  consider  Figure  6.  This 
figure  shows  the  simulation  of  the  max  system  trajectory  of  Figure  5  with  a2  =  16 
and  5(0)  =  max(Far(0)  +  7,0).  Note  that,  compared  with  the  original  max  system, 
the  switching  is  “delayed”  and  the  trajectories  are  smoother,  as  expected. 

By  changing  basis  with  the  matrix  T  =  blockdiagjP,  1},  where  P  is  chosen  so 
that  the  matrices  PAP~l  and  PB  are  in  the  so-called  controller  canonical  form  (see 
Equations  (6)  and  (7)),  we  obtain 

Definition  14  (Canonical  Simulated  Max  System) 

x  =  y 

y  =  —  ax  —  by  +  S 
5  =  a2[max(/x  4-  gy  +  7, 0)  —  5] 

subject  to  initial  conditions 

x(0)=a;o,  2/(0)  =  yo,  5(0)  =  mwx(fx0  +  gyo  +  7,0) 

where  a,  b,  a  —  f,  and  b  —  g,  are  greater  than  zero;  7  <  0;  and  a^0. 

This  is  the  system  we  will  study  in  the  remainder  of  this  section.  Note  the  added 
constraint  on  the  initial  condition  of  5.6 

Remark  15  The  only  equilibrium  point  of  this  system  is  the  origin,  which  is  locally 
asymptotically  stable  (when  7  <  0J. 

Proof  From  the  first  two  equations,  we  have  the  constraints  y  =  0  and  5  =  ax.  From 
the  last  one  we  obtain  the  following  two  cases: 

1.  fx  +  7  <  0:  —ax  =  0,  which  implies  x  =  5  =  0. 

6  The  constraint  on  5(0)  is  for  convenience.  It  can  be  relaxed  to  be  within  e  of  this  value  (where 
e  arises  in  our  proofs  below),  with  the  same  analytical  results  holding  true.  Specifically,  Fact  16  still 
holds  when  Equation  (8)  is  replaced  by  |<5(0)  —  max(/a:(0)  +  gy( 0)  +  7, 0) |  <  e. 
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2. 


fx  +  7  >  0:  (—a  +  f)x  +  7  =  0,  which  implies  x  = 
can’t  occur  since 


fx  +  7  = 


/  7 

(a  ~  /) 


+  7  = 


a-y 

(«-/) 


7/0  -  /)• 
<  0 


However,  this 


The  origin  is  locally  asymptotically  stable  because  it  is  a  linear  system  in  some  neigh¬ 
borhood  of  the  origin  (since  7  <  0).  □ 

This  system  is  globally  asymptotically  stable  when  /  =  g  =  0,  because  it  reduces  to 
a  stable  linear  system  in  this  case.  For  the  special  case  where  7  =  0,  both  component 
linear  systems  can  be  made  stable  by  choosing  a  large  enough.  However,  this  in  itself 
does  not  imply  that  the  whole  system  is  stable.  We  say  more  about  this  case  at  the 
end  of  the  section. 

The  rest  of  this  section  explores  the  stability  of  the  simulated  max  system  by  using 
Lemma  3. 


4.1  Asymptotic  Stability  within  Arbitrary  Compact  Sets 

In  this  subsection  we  show  that  the  simulated  max  system  can  be  made  asymptotically 
stable  to  the  origin — within  an  arbitrary  compact  set  containing  the  origin — by  choos¬ 
ing  the  parameter  a  large  enough.  Important  note:  Since  S  is  subject  to  initial 
conditions  depending  on  x  and  y  (see  Definition  13),  this  stability  is  with  respect  to 
arbitrary  sets  of  initial  conditions  for  x  and  y  only.  This  subsection  only  considers 
the  case  7  <  0.  In  this  case,  the  plane  fx  +  gy  +  7  =  0  is  a  positive  distance,  call  it 
d,  away  from  the  origin.  Further,  the  three-dimensional  linear  system  associated  with 
the  simulated  max  system  about  the  origin  with  matrix: 

'01  0* 

—a  —b  1 
0  0  -a2 

is  asymptotically  stable,  so  there  is  some  (open)  ball  around  the  origin  (in  R 3)  of  radius 
As  <  d  such  that  once  a  trajectory  of  the  simulated  max  system  enters  the  ball  of 
radius  A5,  it  tends  toward  the  origin.  Similarly,  the  max  system  is  an  asymptotically 
stable  linear  system  near  the  origin,  so  there  is  some  ball  around  the  origin  (in  R2)  of 
radius  Am  <  d  such  that  once  a  solution  to  the  max  system  enters  the  ball  of  radius 
Am,  it  tends  towards  the  origin.  For  convenience,  define  A  =  min(Am,  As). 

Now,  note  that  the  max  system  and  simulated  max  system  can  be  written  in  the 
form  required  by  Lemma  3  by  choosing 


i.e., 


F(x,y,t)  =  max(/r  +  gy  +  7, 0) 

G(x,  y,  t)  =  S 

where  6  =  a2[max(/x  +  gy  +  7,0)  —  <5].  An  important  fact  is  the  following: 
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Fact  16  Given 


(8) 


5(0)  =  max(/x(0)  +  gy{  0)  +  7,0) 
and  e  >  0,  we  can  choose  a  large  enough  so  that 

|5(t)  -  ma x(/x(2)  +  gy(t)  +7,0)|  <  e,  t  >  0 

Proof  Since  ma x(/x  +  gy  +  7, 0)  is  Lipschitz  continuous,  we  can  apply  Lemma  6 
with  u(-)  =  ma x(/x(-)  +  gy(-)  +7,0),  x(-)  —  S(-),  and  eo  =  0.  □ 

Below,  let  p(t)  and  cr(t)  represent  solutions  to  the  max  and  simulated  max  systems, 
respectively.  Next,  consider  the  projection  operator 

7r  :  f?3  -4  R2 
7r([x,y,5]r)  =  [x,y]T 

Remark  17  If  7  <  0,  the  simulated  max  system  can  be  made  asymptotically  stable  to 
the  origin  within  an  arbitrary  compact  set  containing  it  by  choosing  the  parameter  a 
large  enough. 


Proof  First,  pick  any  compact  set,  12,  containing  the  origin  (of  the  max  system). 
Next,  we  examine  the  trajectories  of  the  max  and  simulated  max  systems  from  an  arbi¬ 
trary  initial  condition,  po  €  12.  Recall  that  So,  and  hence  ctq,  is  completely  determined 
by  po-  In  particular,  5q  =  max(/xo  +  gyo  +  7,0)  and  7r(ero)  —  Mo- 

Since  the  max  system  is  globally  asymptotically  stable,  there  is  a  time,  T(p 0,  A), 
such  that  for  t  >  T,  we  have  ||m(£)||  <  A/3.  Thus,  we  have  max(fx(t)+gy(t)+/y,  0)  =  0 
for  all  t  >  T.  Now,  according  to  Fact  16  we  can  pick  a  large  enough  so  that 


e  <  min 


f  A  A  (77  +  cL)  \ 
\3'  3c  (e(v+^)T-  1)  J 


(9) 


At  this  point,  we  have,  from  Lemma  3, 

||m(T)  -  7r(a(T))||  <  (e^T  -  l)  <  | 

Now,  by  construction  we  have  |5|  <  A/3.  Thus,  we  have  ||cr(T)||  <  A.  From  this  point 
on,  aft)  tends  asymptotically  toward  the  origin. 

Finally,  since  f2  is  compact,  there  is  a  finite  time  r  >  T(p 0,  A)  for  all  po  €  Q.  Thus, 
we  can  pick  e  (and  then  a)  to  achieve  the  desired  inequality  for  all  initial  conditions. 

□ 

Note  that  if  77  +  cL  <  0,  then  e — and  hence  a — can  be  chosen  constant  for  all 
T.  On  the  other  hand,  if  77  +  cL  >  0,  restrictions  on  the  magnitude  of  a  may  only 
guarantee  asymptotic  stability  within  some  finite  distance  from  the  origin. 

It  is  also  important  to  realize  that  the  same  analysis  holds  for  any  other  dynamic 
or  nondynamic  continuous  variable  used  to  approximate  the  max  function,  if  it  is  such 
that  it  can  be  kept  within  e  of  the  max  function  for  arbitrary  e.  (Also  recall  Footnote 
6.) 
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4.2  The  Case  7  =  0 

For  the  special  case  7  =  0,  the  simulated  max  system  represents  a  switching  between 
the  following  component  linear  systems: 


Ax 


A2 


0  10 
—a  —b  1 
0  0  —a2 

0  1  0 
—a  —b  1 
fa 2  ga2  —a2 


Remark  18  Both  component  linear  systems  can  be  made  stable  by  choosing  a  large 
enough. 


Proof  (See  Appendix  A.)  □ 

Thus  the  component  linear  systems  of  the  simulated  max:  system  with  7  =  0  can 
be  chosen  so  both  are  stable.  However,  this  in  itself  does  not  imply  that  the  whole 
system  is  stable.7 

The  comparison  arguments  of  the  previous  subsection  do  not  apply  now  since  we 
cannot  find  a  A  like  we  did  there.  Thus,  we  can  only  use  Lemma  3  to  get  bounds 
on  the  trajectories  of  the  simulated  max  system.  Note,  however,  that  if  77  +  cL  <  0 
then  global  asymptotic  stability  of  the  max  system  implies  ultimate  boundedness  of 
the  simulated  max  system. 

One  may  be  able  to  say  more  about  specific  instances  of  the  simulated  max  system 
(i.e.,  knowledge  of  the  constants).  For  example,  some  cases  may  yield  to  our  robustness 
of  linear  ODEs  lemma  by  comparing  the  case  7  =  0  with  7  =  —  e.  Alternatively,  one 
could  invoke  robustness  results  in  the  literature,  e.g.,  [2,  Theorem  6.1].  These  tools 
can’t  be  invoked  in  the  general  case  because,  roughly,  the  parameter  a  affects  both  77 
and  L  in  conflicting  fashion. 


5  Summary  and  Conclusions 

This  paper  detailed  work  on  continuous  switching  systems.  Although  one  might  not 
guess  from  the  presentation  above,  the  theory  in  Section  2  was  developed  to  analyze 
the  example  systems  of  Sections  3  and  4.  Here,  we  set  the  record  straight. 

In  Section  3,  we  presented  an  example  hybrid  control  problem:  the  max  system. 
This  system  was  inspired  from  one  used  in  the  control  of  modern  aircraft.  The  control 
law  uses  a  logical  function  (max)  to  pick  between  one  of  two  stable  controllers:  one 
a  servo  that  tracks  pilot  inputs,  the  second  a  regulator  about  a  fixed  angle  of  attack. 
Typically,  engineers  resort  to  extensive  simulation  of  even  such  simple  systems  because 
the  analysis  is  too  hard  with  their  present  toolbox.  However,  we  analyzed  the  stability 
of  this  hybrid  system  in  the  case  where  the  pilot  input  is  zero  and  the  controllers  are 
linear  full-state  feedback.  We  showed  that  no  limit  cycles  exist  by  proving  and  applying 
an  extension  of  Bendixson’s  Theorem  to  the  case  of  Lipschitz  continuous  vector  fields; 

7  A  counterexample  can  be  constructed  after  one  that  appears  in  [16]:  Use  the  asymptotically  stable 
systems  of  Figures  7  (System  I)  and  8  (System  II),  activating  System  I  in  quadrants  4  and  2,  System 
II  in  quadrants  3  and  1. 
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we  also  gave  a  Lyapunov  function  that  proved  all  systems  of  this  form  are  globally 
asymptotically  stable.  Interestingly,  the  Lyapunov  equation  used  a  logical  switching. 

In  Section  4,  we  presented  an  analysis  of  a  simulation  of  the  max  system.  That 
is,  we  used  a  differential  equation  to  obtain  a  “smooth”  function  instead  of  using 
the  output  given  by  the  max  function  directly.  By  extending  a  result  in  the  theory  of 
continuity  of  solutions  of  ordinary  differential  equations,  we  proved  stability  properties 
of  the  simulation  from  those  of  the  original  max  system. 

Although  the  attention  was  focused  by  our  examples  and  their  analysis,  we  de¬ 
veloped  tools  and  insights  along  the  way  that  should  prove  useful  in  tackling  general 
hybrid  systems  problems. 


A  Assorted  Proofs 


A.l  Continuity  Lemmas 

The  proofs  of  our  continuity  lemmas  depend  critically  on  the  well-known  Bellman- 
Gronwall  inequality  [3,  p.  252]: 

Lemma  19  (Bellman-Gronwall)  Let 

1.  f ,  g,  k;  R+  R  and  locally  integrable; 


2.  g  >  0,  k  >  0; 
5.  g  £  Lf; 


4 .  gk  is  locally  integrable  on  R+. 

Under  these  conditions,  if  u  :  R+  — >  R  satisfies 

u(t)  <  f(t)  +  g{t)  [  k(r)u(r)dT,  for  all  t  £  R+ 
Jo 

then 


u(t)  <  f{t)  +  g(t)  f  k{r)f(r) 
Jo  L 

Proof  [of  Lemma  2]  For  any  t  > 


exp 

0, 


dr, 


for  all  t  £  R+ 


Subtracting  yields 
x(t)  -  y{t ) 


ll*(f)  -y  0011 


x(t)  =  xo  +  [  F(x,r)dr 
Jo 

y{t)  =  x0+  G(y,r)dr 
Jo 

=  /  F(x,r)dr  —  f  G{y,r)dr 

Jo  Jo 

=  /  [F(x,  t)  -  F(y,  r)  +  F(y,  r)  -  G{y,  r)}dr 

Jo 

=  [  [F(x,r)  -  F(y,r)  +  F(y,r)  -  G(y,r)]dr 

Jo 

<  f  \\F(x,r)  -  F(y,r)\\dr  +  [  \\F(y,r)  -  G{y,r)\\dr 

Jo  Jo 

<  L  [  \\x(r)  -  y(r)\\dr  +  et 

Jo 
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Using  the  Bellman-Gronwall  Lemma,  we  obtain 


If  L  =  0 

and  if  L  >  0,  we  compute 


\\x(t)  —  y(t)\\  <  et  +  J  Ler  exp  J  Lda 
=  e| t  +  L,J  TeL(t~T^d,T^j 
=  e^t  +  LeLt  J  re_£,rdr| 

II x(t)  -  y(t)||  =  et 


dr 


ft 

’e~Lr 

/  re  Lrdr  = 

Jo 

[e 

e~Lt  1 

-jj2~(Lt  +  1)  +  £2 


Therefore, 


N*)-y(t)ll  <  e\t-t-  ^  +  ^eLt} 
=  I  («“-0 


□ 


Proof  [of  Lemma  3]  For  any  t  >  0, 

x(t )  =  eAtxo+  [  eA^~T^ F{x,r)dr 

Jo 

y(t )  =  eAtxo  +  [  eA{t~r)G{y,T)dT 

Jo 

Subtracting  yields 

x(t)~y{t)  =  [  eA^~T)[F(x,T)  -  F(y,T)  +  F(y,r)  -  G(y,T)\dr 

Jo 

l|s(t) -y(<)ll  <  /  \\zA{t~T)\\i\\F{x,T)  -  F{y,T)\\dT  +  (  ||eA(t_T)||i||F(y,r)  -  G(y,r)\\d7 

Jo  Jo 

<  l[  \\eA^)\\i\\x(T) -y{r)\\dT +  €  f  ||eA(t_T)||idr 
Jo  Jo 


Now  we  are  given  that  ||eAiS||j  <  cePs  so  that 


VI 

T 

I 

•+o 

ce* 

f* e~VTdr 

Jo 

J 

'o 

< 

-e* 

(l  -  e-*) 

y 

\  J 

(10) 
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Therefore, 


IM<j  -  y(t) ||  <  cLevt  e  vt\\x{t)  -  y(r)||dr  +  ^  (ent  -  l)  (11) 

Using  the  Bellman-Gronwall  Lemma,  we  obtain 

||®(t)  -  y(t)  ||  <  —  (evt  -  l)  +  cLe *  P  e~^T  —  (e’JT  -  1)  [exp  e~^  cLe7'0  do\  dr 

V  v  1  Jo  v  L  Jt 

1  +  cLevt  [ ‘  (1  -  e_I7T)  ecL(t~r)rfr 

Vo 

-  1  +  cLevtecLt  J*  (e~cLr  -  er(r?+cL)T)  dr  (12) 


ec 

V 

ec 


V 
ec 

V 
ec 

V 
ec 


oVt 


1  +  cLe^+cL)t  (\-  \e~cLt  +  — i—e-(??+cL)t 


1 


e7**  -  1  +  e^+ci)t  -  e7'*  + 


\cL  cL 
cL 


r]  +  cL 


rj  +  cL 


cL 


,{ri+cL)t 


rj  +  cL  r)  +  cL 


cL 


r)  [rj  +  cL 


-1  [l  -  e^+c^t' 


ec 

V 


-V 


1  —  e 


(t) +cL)t 


T ?  +  cL  I 

\e^cL*  -  ll 

4-  cL  L  J 


r}  +  cL 

Proof  [of  Corollary  4]  Now  we  deal  some  special  cases  not  covered  above: 

1.  If  L  =  0  but  rj  ^  0,  then  Equation  (11)  gives 

IM()-«(f)ll<|(e’"-l) 

If  77  =  0  then  Equation  (10)  is  replaced  by 

A e^-^Widr  <ct 
Jo 

2.  So,  if  77  =  0  and  L  =  0 

Mt)~y{t)  ||  <  cet 

3.  If  i)  =  0  and  L  >  0  then  Equation  (11)  is  replaced  by 

IMi)  -  y(*)||  <cL  [  || x(t)  -  y(r)\\dr  +  ect 
Jo 

in  which  case  the  Bellman-Gronwall  Lemma  gives 

ll*(£)  —  y(t)\\  <  ect  +  cLJ0  ecr  I  exp  J  cL  dcrj  dr 

<  ect  +  ec2L  f  TecL<^~T^dT 
Jo 


□ 


(13) 


<  ect  +  ec2LecLt  [  TecLTdr 

Jo 
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Now  repeating  the  calculation  of  Equation  (10)  with  cL  identified  with  L: 

o  —  cLt  ^ 


,2  t  „cLt 


\x(t)  —  y(t)\\  <  ect  +  eczLe 


(cLy 

cLt 


;{Lt  +  1)  + 


(cL)< 


<  ect  —  ect  —  —  +  ye 

^  IK"1) 

4.  If  rj  ^  0  and  L  >  0  but  rj  +  cL  =  0  (this  means  rj  <  0),  then  Equation  (12)  and 
the  further  computations  simplify  to 


ll*(f)  -y(0ll 


ec 

V  L 
ec 

V  L 


e*  -  1  +  cL 

rjt 


i + cl  ( 4  -  4e_cit  - 4 

cL  cL 


^  [e7'*  -  1  +  1  -  e-c"  -  cLt] 
[e7*4  _  _  cLt] 


V 

ec 


A. 2  Singular  Perturbation  Lemmas 
Proof  [of  Lemma  6]  Let  e  =  z  —  u.  Then 

d+e  d+z  d+u 


dt 


dt  dt 
=  a2(u  —  z)  — 


d+u 

dt 


-a2e 


d+u 

dt 


where 


d+z  z{t  +  h)  —  z(t) 

~dT  =  £<?+  h 


Now,  since  u  is  Lipschitz,  we  have 


d+u 


dt 


<  L 


Thus,  if  we  choose  a  such  that  a2  >  L/e,  then  when  e  >  e,  we  have 

d+e 


dt 


<  - ore  +  L  <  0 


Similarly,  when  e  <  —  e,  we  have 


d+e 

dt 


>  ore  —  L  >  0 


Thus,  the  set  |e|  <  e  is  an  invariant  set. 


□ 
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A. 3  Max  System 

Proof  [of  Fact  8]  We  first  need  the  following  theorem  [8,  Theorem  3.10]: 

Theorem  20  (Kwakernaak  and  Sivan)  Consider  the  time-invariant  system 

x(t)  =  Ax(t)  +  Bu(t), 
z(t)  =  Dx(t), 

where  z  and  u  have  the  same  dimensions.  Consider  any  asymptotically  stable  time- 
invariant  control  law 

u(t)  =  —Fx(t)  +  u'{t). 

Let  H (s)  be  the  open-loop  transfer  matrix 

H{s)  =  D{sl  —  A)~1B, 
and  Hc{s)  the  closed-loop  transfer  matrix 

Hc{s)  =  D(sl  —  A  +  BF)~lB. 

Then  Hc( 0)  is  nonsingular  and  the  controlled  variable  z(t)  can  under  steady-state 
conditions  be  maintained  at  any  constant  value  z$  by  choosing 

u' it)  =  H~1(0)zq 


if  and  only  if  H (s)  has  a  nonzero  numerator  polynomial  that  has  no  zeroes  at  the 
origin. 

For  our  system,  we  have 


Cx{sI-A)-lB 


0.1(g -9) 
s2  +  2s  4-  11 


which  has  a  nonzero  numerator  with  no  zeroes  at  the  origin. 


□ 


A. 4  Simulated  Max  System 

Proof  [of  Remark  18]  A\  is  stable  because  it  is  upper  block  triangular  with  stable 
blocks.  One  can  check  that  the  characteristic  polynomial  of  A<i  is 

A3  +  (b  4-  o2)A2  +  [a  4-  a2(b  -  <?)]A  +  [ a2(a  —  /)]  =  A3  +  o' A2  +  /?'  A  +  y1 


The  Routh  test  (to  verify  stable  roots)  reduces  here  to  [12,  p.  175]: 

1.  o',  /?',  i  >  0 

2.  /?'  >  i/of 

The  first  of  these  is  verified  by  our  conditions  on  a,  b,  /,  g,  and  a.  The  second  says 
we  need 

a2 (a-  f) 


a  +  or(5  —  g)  > 


b  +  a2 
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which  reduces  to 


a4(b  —  g)  +  a2[b(b  —  g)  +  f]  +  ab  >  0 


aA  +  a2 


b  + 


f 


ab 


(b-g)  J  (b-g) 


>  0 


Since  the  last  term  on  the  left-hand  is  positive  by  our  previous  conditions  (a,  b,  and 
6  —  g  greater  than  zero)  it  is  sufficient  for 


a4  +  a2 


b  + 


f 


or  +  b  + 


Again,  since  6  >  0,  it  is  sufficient  for 


a2  +  f 


( b-g ) 


(b-g)  J 

/ 

(b-g) 


>  o 


>  0 
>  0 


a2  > 


-/ 


(b-g) 


□ 


B  Bendixson  Extension 


This  appendix  treats  the  background,  statement,  and  proof  of  our  extension  of  Bendix- 
son’s  Theorem. 

Bendixson’s  theorem  gives  conditions  under  which  a  region  cannot  contain  a  peri¬ 
odic  solution  (or  limit  cycle).  It  is  usually  stated  as  follows  (statement  and  footnote 
adapted  from  [17,  pp.  31-32]): 

Theorem  21  (Bendixson’s  Theorem)  Suppose  D  is  a  simply  connected?  domain 
in  R 2  such  that  the  quantity  V/(x)  (the  divergence  of  f)  defined  by 


V/ Or)  = 


dfi  ,  x  <9/2 ,  x 


is  not  identically  zero  over  any  subregion  of  D  and  does  not  change  sign  in  D.  Then 
D  contains  no  closed  trajectories  of 


i  iCO  =  fi[x\(t),x2(t)] 

X2  (t)  =  f2[xi(t),X2(t)\ 

The  proof  of  Bendixson’s  Theorem  depends,  in  a  critical  way,  on  Green’s  Theorem. 
The  usual  statement  of  Green’s  Theorem  says  [10]  that  a  C 1  vector  field  f(x)  on  a 
compact  region  A  in  Rn  with  Cl  boundary  B  satisfies 

f  f  (x)  ■  n(A,  x)da  =  [  Vf(x)dCnx 
JB  Ja 

8 A  connected  region  can  be  thought  of  as  a  set  that  is  in  one  piece,  i.e.,  one  in  which  every  two 
points  in  the  set  can  be  connected  by  a  curve  lying  entirely  within  the  set.  A  set  is  simply  connected 
if  (1)  it  is  connected  and  (2)  its  boundary  is  connected. 
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where  n(A,x)  is  the  exterior  unit  normal  to  A  at  x,  da  is  the  element  of  area  on  B, 
and  Cn  is  the  Lebesgue  measure  on  Rn.  It  is  possible,  however,  to  treat  more  general 
regions  and  vector  fields  that  are  merely  Lipschitz  continuous.  A  general  extension  is 
the  so-called  Gauss- Green-Federer  Theorem  given  in  [10].  Even  the  statement  of  this 
theorem  requires  the  development  of  a  bit  of  the  language  of  geometric  measure  theory. 
We  state  a  relaxed  version  of  this  theorem  that  is  still  suitable  for  our  purposes.  In  the 
final  formula,  V/  exists  almost  everywhere  because  a  Lipschitz  continuous  function  is 
differentiable  almost  everywhere. 


Theorem  22  (Relaxation  of  Gauss- Green-Federer)  Let  A  be  a  compact  region 
of  Rn  with  C 1  boundary  B.  Then  for  any  Lipschitz  vector  field  f(x), 


f  f(x)-n(A,x)da  =  f  Vf(x)dCna 
Jb  Ja 


Now  we  can  prove  our  version  of  Bendixson’s  Theorem,  which  we  repeat  for  con¬ 
venience: 

Theorem  1  (Extension  of  Bendixson’s  Theorem)  Suppose  D  is  a  simply  con¬ 
nected  domain  in  R2  and  f(x)  is  a  Lipschitz  continuous  vector  field  on  D  such  that 
the  quantity  V/(x)  (the  divergence  of  f,  which  exists  almost  everywhere)  defined  by 

V/(x)  =  ~{xi,x2)  +  H(*i,*2) 

is  not  zero  almost  everywhere  over  any  subregion  of  D  and  is  of  the  same  sign  almost 
everywhere  in  D.  Then  D  contains  no  closed  trajectories  of 


x\ (t)  =  fi[xi(t),x2{t)} 
X2  (t)  =  f2[xi(t),x2(t)} 


(14) 

(15) 


Proof  The  proof  is  similar  to  that  of  Bendixson’s  Theorem  in  [17,  pp.  31-32]. 
Suppose,  for  contradiction,  that  J  is  a  closed  trajectory  of  Equations  (14)-(15). 
Then  at  each  point  x  €  J,  the  vector  field  /(x)  is  tangent  to  J.  Then  /(x)  n (S,x)  =  0 
for  all  x  €  J,  where  S  is  the  area  enclosed  by  J.  But  by  Theorem  22 


0  =  f  f(x)-n(A,x)dl=  [  Vf(x)dC‘ 
Jj  Js 


x 


Therefore,  we  must  have  either  (i)  V/(x)  is  zero  almost  everywhere,  or  (ii)  the  sets 
{x  €  SjV/(x)  <  0}  and  {x  €  5|V/(x)  >  0}  both  have  positive  measure.  But  if  S 
is  a  subset  of  D ,  neither  can  happen.  Hence,  D  contains  no  closed  trajectories  of 
Equations  (14)— (15).  □ 
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Figure  1:  Longitudinal  Aircraft  View 


Figure  2:  The  Max  Control  System 
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Figure  3:  Outputs  of  the  tracking  controller:  (a)  normal  acceleration,  nz  (solid),  and 
desired  normal  acceleration,  r  (dashed);  (b)  angle  of  attack,  a  (solid),  and  ct’s  limit 
(dashed). 


Figure  4:  Outputs  of  the  max  controller:  (a)  normal  acceleration,  nz  (solid),  and 
desired  normal  acceleration,  r  (dashed);  (b)  angle  of  attack,  a  (solid),  and  a’s  limit 
(dashed). 
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